On empirical Bayes estimation of multivariate regression coefficient
نویسندگان
چکیده
We investigate the empirical Bayes estimation problem of multivariate regression coefficients under squared error loss function. In particular, we consider the regression model Y = Xβ+ ε, where Y is an m-vector of observations, X is a known m× k matrix, β is an unknown k-vector, and ε is anm-vector of unobservable random variables. The problem is squared error loss estimation of β based on some “previous” data Y1, . . . ,Yn as well as the “current” data vector Y when β is distributed according to some unknown distribution G, where Yi satisfies Yi = Xβi + εi, i = 1, . . . ,n. We construct a new empirical Bayes estimator of β when εi ∼N(0,σIm), i= 1, . . . ,n. The performance of the proposed empirical Bayes estimator is measured using the mean squared error. The rates of convergence of the mean squared error are obtained.
منابع مشابه
Empirical Bayes Estimation in Nonstationary Markov chains
Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical Bayes estimators for the transition probability matrix of a finite nonstationary Markov chain. The data are assumed to be of a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...
متن کاملEfficient Empirical Bayes Variable Selection and Estimation in Linear Models
We propose an empirical Bayes method for variable selection and coefficient estimation in linear regression models. The method is based on a particular hierarchical Bayes formulation, and the empirical Bayes estimator is shown to be closely related to the LASSO estimator. Such a connection allows us to take advantage of the recently developed quick LASSO algorithm to compute the empirical Bayes...
متن کاملInvariant Empirical Bayes Confidence Interval for Mean Vector of Normal Distribution and its Generalization for Exponential Family
Based on a given Bayesian model of multivariate normal with known variance matrix we will find an empirical Bayes confidence interval for the mean vector components which have normal distribution. We will find this empirical Bayes confidence interval as a conditional form on ancillary statistic. In both cases (i.e. conditional and unconditional empirical Bayes confidence interval), the empiri...
متن کاملLimiting Properties of Empirical Bayes Estimators in a Two-Factor Experiment under Inverse Gaussian Model
The empirical Bayes estimators of treatment effects in a factorial experiment were derived and their asymptotic properties were explored. It was shown that they were asymptotically optimal and the estimator of the scale parameter had a limiting gamma distribution while the estimators of the factor effects had a limiting multivariate normal distribution. A Bootstrap analysis was performed to ill...
متن کاملMultivariate nonparametric regression using lifting
For regularly spaced one-dimensional data wavelet shrinkage has proven to be a compelling method for nonparametric function estimation. We argue that this is not the case for irregularly spaced data in two or higher dimensions. This article develops three methods for the multiscale analysis of irregularly spaced data based on the recently developed lifting paradigm by “lifting one coefficient a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Int. J. Math. Mathematical Sciences
دوره 2006 شماره
صفحات -
تاریخ انتشار 2006